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ABSTRACT 

A Cayley tree model of idiotypic networks that includes both B cell and anti- 
body dynamics is formulated and analyzed. As in models with B cells only, localized 
states exist in the network with limited numbers of activated clones surrounded by 
virgin or near-virgin clones. The existence and stability of these localized network 
states are explored as a function of model parameters. As in previous models that 
have included antibody, the stability of immune and tolerant localized states are 
shown to depend on the ratio of antibody to B cell lifetimes as well as the rate of 
antibody complex removal. As model parameters are varied, localized steady-states 
can break down via two routes: dynamically, into chaotic attractors, or structurally 
into percolation attractors. For a given set of parameters, percolation and chaotic 
attractors can coexist with localized attractors, and thus there do not exist clear 
cut boundaries in parameter space that separate regions of localized attractors from 
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regions of percolation and chaotic attractors. Stable limit cycles, which are frequent 
in the two-clone antibody B cell (AB) model, are only observed in highly connected 
networks. Also found in highly connected networks are localized chaotic attractors. 
As in experiments by Lundkvist et al. (1989), injection of Abi antibodies into a 
system operating in the chaotic regime can cause a cessation of fluctuations of Abi 
and Ab2 antibodies, a phenomenon already observed in the two-clone AB model. In- 
terestingly, chaotic fluctuations continue at higher levels of the tree, a phenomenon 
observed by Lundkvist et al. but not accounted for previously. 
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1. INTRODUCTION 

Jerne (1974) postulated that the immune system functions as a network, where 
lymphocytes are stimulated or suppressed by "idiotypic" interactions with comple- 
mentary antibodies and immunoglobulin receptors. Since then, experimental evi- 
dence of an active immune network has been found (Holmberg et al., 1984; Kearney 
and Vakil, 1986; Lundkvist et al., 1989). Several theories have been advanced for 
a biological function of this idiotypic network, among them is the idea that im- 
munological memory is a dynamic consequence of network interactions (Hoffmann, 
1975; Richter, 1975; Farmer et al., 1986; Weisbuch, 1990; Weisbuch et al., 1990; 
Behn et al., 1992). Under the "dynamic memory hypothesis" after initial antigen 
exposure, an expanded, neutralizing clonal population is sustained through network 
interactions with idiotypically related clones. Mathematical models have been for- 
mulated to make these ideas more precise (for reviews see Perelson, 1989; Varela 
and Coutinho, 1991; and De Boer et al., 1992a). 

Immune network models can be classified by the degree of complexity with 
which they model (i) the structure of network connectivity and (ii) the dynamics of 
individual clonal species. Network structure has been modeled with varying degrees 
of realism. 

The simplest model structure describes the dynamics of a pair of complemen- 
tary B cell clones. We refer to this class as "two-clone models". Variations of these 
models have been studied extensively (Perelson, 1989; De Boer et al., 1990; Stew- 
art and Varela, 1990). (A rigorous dynamical analysis of two-clone models - under 
a variety of assumptions for clonal dynamics - is given by De Boer, Kevrekidis 
and Perelson (1993a,b).) Two-clone models have the advantage of mathematical 
tractability and shed light on the dynamics of clonal populations as a function of 
model assumptions and parameters. But, they are insufficient for investigations of 
the effects of network structure on dynamical behavior. 

The next level of model complexity introduces network connectivity. This has 
been done in two ways. One method prescribes the network structure using static, a 
priori connectivity assumptions. For example, Cayley tree models assume a uniform 
connectivity structure (Weisbuch et al., 1990). Other models prescribe a network 
structure based on experimentally known interactions (Stewart and Varela, 1989) 
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or assume random connectivity matrices (Hoffmann, 1982; Sponge, 1986; De Boer, 
1988). The second method allows network connectivity to develop from assumptions 
of affinity matching rules, which in turn, determine idiotypic interactions. This class 
of models includes bit-string models (Farmer et al., 1986; De Boer and Perelson, 
1991; Celada and Seiden, 1992), as well as other shape-space models (Segel and 
Perelson, 1988, 1989; Weinand, 1990; Weisbuch, 1990; Stewart and Varela, 1991; 
De Boer et al., 1992b). 

In this study, we analyze one type of prescribed network model: a homogeneous 
Cayley tree model. Previous models of this class modeled B cell populations but 
not their corresponding antibodies (Weisbuch et al., 1990; Neumann and Weisbuch, 
1992a,b). It was shown that in certain parameter ranges, this model possesses 
localized steady-states, where a large population at one level could be sustained by 
idiotypic interactions with small or intermediate populations of clones at the next 
level, and neighboring clones in the network would remain virgin or near-virgin. 
For example, if antigen is assumed to only interact with the level 1 clone, then 
a localized state occurs when the second level populations are not high enough 
to stimulate proliferation of third level populations. These localized states were 
presented as models of immune network "memory" or "tolerance" , depending upon 
whether the field at level 1 was low or high. 

In their analysis of two-clone models, De Boer et al. (1993a,b) show that 
when antibody dynamics are included, what would be stable system attractors in 
a simple B cell model may become oscillatory or chaotic, depending on parameter 
values. Here, we investigate the effect of antibody dynamics on the stability of 
states in a Cayley tree model. We call this model the "AB Tree model", where 
AB stands for antibody and B cell dynamics, and Tree stands for the Cayley tree 
topology. 

We show that the addition of antibody dynamics does not substantially al- 
ter the steady-states observed in the work of Weisbuch and colleagues and that 
isolated, non-oscillatory states are readily obtained. We derive conditions for the 
existence and stability of these localized states and perform bifurcation analyses on 
the model. As network connectivity is increased, localized steady-states disappear 
and only chaotic attractors and nonlocalized steady-states remain. Non-localized 
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steady- states are referred to as "percolation" attractors. They are states in which 
ahernating levels of clones are activated throughout the network. As dynamical 
parameters (such as the ratio of the antibody death rate or complex removal rate to 
the B cell death rate) are decreased, stable localized steady-states lose stability and 
and trajectories approach what appear to be chaotic attractors. These attractors, 
as is the case with percolation attractors, generally do not remain localized in the 
network, and signals eventually propagate through successive levels of the network. 
Information about initial conditions is generally lost in both of these attractors 
and there is no way to know which level was originally stimulated. However, we 
do find localized chaotic attractors and limit cycle behavior in parameter regimes 
characterized by high connectivity. Nevertheless, if real immune systems operate in 
parameter domains characterized by nonlocalized behavior, it would be difficult to 
see how they could account for dynamical memory. Finally, we will discuss other 
limitations of this approach toward understanding immune network behavior. 



We consider individual B cell clones which are formed in the bone marrow, 
proliferate in response to stimulation, and die in the periphery. The corresponding 
antibodies are secreted by the B cells in response to stimulation, decay in the 
periphery, and are actively removed or inactivated by complex formation with other 
antibodies. Following previous work (Weisbuch et al., 1990; Varela and Coutinho, 
1991; Perelson, 1989; De Boer and Perelson, 1991), we assume for each clone i, the 
total amount of idiotypic stimulation is a linear combination of the concentration 
of antibodies of all other clones j. The amount of stimulation detected by a clone 
i is referred to as it's field, hf. 



where Jij is the affinity between clone i and the antibodies of clones j and aj is 
the concentration of antibody j. We assume Jij = (no interaction) or Jij = 1 
(maximum affinity). Without loss of generality one can make the maximum affinity 
any real positive number, K, rather than 1, however for reasons of simplicity we 
choose K = 1. 

Network structure is determined by this affinity, or connectivity matrix. 



2. THE AB Tree MODEL 
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Proliferation of B cell clones and antibody secretion rates are a function of their 
stimulation. In this model, we use a phenomenological biphasic activation function: 

/(".) - (^TTTS) (S^TM ■ (^■^' 

where 62 ^ Oi. The maximum activation level is close to 1 and occurs at the 
intermediate field strength, h = ^/QxQi- The use of this function has theoretical 
and experimental justification and has been used extensively in immune system 
models (Varela and Coutinho, 1991; Perelson, 1989; De Boer and Perelson, 1991; 
De Boer et al., 1992a,b, 1993a,b). Activation is thought to be proportional to 
the proportion of surface immunoglobulin that is crosslinked. Biophysical models 
of receptor crosslinking of bivalent ligands predict a symmetric, log bell-shaped 
crosslinking curve (Perelson and DeLisi, 1980); furthermore, antibody production 
follows a similar empirical dose-response curve (Celada, 1971). 

We model the population change of clone i with a pair of differential equations 
representing the B cells hi and the concentration of their antibodies a^: 

^ = m+pf{hi)bi-dBbi , 

(2.3) 



^ = sf{hi)hi - dAtti - dcaihi , 

where / is the activation function, m is the bone marrow source rate, and is 
the B cell death rate. The proliferation parameter, p, must be such that when B 
cells are stimulated, their growth rate exceeds their death rate or else no clonal 
expansion would occur; thus, 

p>dB . (2.4) 

Parameters in the antibody equations are s, the secretion rate, d^, the antibody 
decay rate, and dc, the rate of complex formation and removal. The parameter dc 
is a combination of several physical parameters, e.g. dc = dcv'^K, where dc is the 
rate of complex elimination by macrophages and phagocytic cells, v is the valence 
of the antibody, and K is the affinity of the idiotype for anti-idiotypic antibodies 
(De Boer et al., 1993a,b). 



In two-clone models, the fields hi and h2 are simply the complementary an- 
tibody populations 02 and ai, respectively. In the Cayley-tree model, the fields 
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incorporate a branching network structure where each clone is connected to z other 
clones (see Fig. 1). The parameter z is called the coordination number of the 
Cayley tree. The field for the root, or first level clone, is then 

hx — za-i , (2.5) 

since the clone at level 1 interacts with z clones at level 2. If antigen is present, it 
is assumed to react only with the clone at level 1, and the field becomes 

hx = za2 + Ag , (2.6) 

where Ag represents the eff'ective antigen concentration (the actual antigen concen- 
tration, multiplied by it's valence and affinity). In fact, this property of antigen 
reactivity defines level 1. Note that in this model, all antibodies at a given level 
are treated equivalently. The state variables hi and thus represent a single B cell 
or antibody population, which is the same for all populations at a given level. All 
subsequent clones experience a field: 

hi = tti-i + {z- l)ai+i , i>l , z>2. (2.7) 

2.1 Parameter Values 

Previous modeling studies have provided estimates for the model parameters 
(Varela and Coutinho, 1991; De Boer and Perelson, 1991; De Boer et al., 1993a,b). 
Briefly, typical parameter estimates are as follows: Due to cell division at the pre-B 
cell stage, each clone will consist of approximately 10-20 cells when it is generated. 
Here, we assume that the bone marrow produces cells of clone z at a constant rate m. 
Because the same clones are probably not produced every day, we use as an average 
production rate about one cell per clone per day, m fa 1. B cells have a lifetime of 
about 2 days, ds ~ 0.5 d~^. Activated cells divide about every 16 hours, p^l 
Antibodies may persist much longer, about 20 days; thus, dA ~ 0.05 d~^. (Varela 
and Coutinho estimate dA^ ^A .) A unit of antibody is the amount of antibody 
produced by a fully matured B cell in one day, thus, measured in units, s = 1 d"-*^. 
Antibody complexes are removed at a rate dc ~ 10~^ d~^ unit"-*^, estimated in De 
Boer and Perelson (1991) where the notation dc = dcK was used. The threshold 
for proliferation is set at 9i = 100. The onset of suppression, or the higher threshold 
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of the dose-rcsponsc curve, is generally set several orders of magnitude higher, i.e. 
6*2 = 10^. Throughout this paper, these estimated parameters will be referred to as 
the "standard" parameter set. 

Connectivity can be defined and measured in a number of ways. In a young 
mouse, any given antibody will crossreact with as much as 23-28% of the other 
antibodies; in adult mice, this percentage reduces to about 1-2% (Holmberg et al., 
1984; Kearney et al., 1987). However, affinities of IgM molecules in immature im- 
mune systems are relatively low and nonspecific. Using accessibility computations, 
Novotny et al., (1987) estimate that a immunoglobulin molecule has 40 distinct 
idiotypic determinants available for anti-idiotypic binding. Not all of these epitopes 
will necessarily result in an idiotypic response, while more than one antibody may 
bind to others. Thus, although 40 could serve as a reasonable estimate for 2;, for 
our standard parameter set, we choose a more conservative, intermediate value of 
z= 10. 

3. STEADY-STATES 

In the following analysis, we find the conditions for the existence of localized 
states for the AB Tree model. We derive estimates for the steady-state B cell 
populations and their corresponding antibodies at each level in the network. We 
then apply stability analysis to these steady-states to find the conditions for the 
stability of these localized states. 

In previous analyses of models that contain only B cells (B models) and that 
employ a log bell-shaped activation function (Weisbuch et al., 1990; De Boer et al., 
1990, 1992a), three possible equilibrium levels for each B cell population have been 
identified: 

1. ) a virgin, or unstimulated, level, m/dB , 

2. ) a large population level corresponding to cells in an "immune" state, that 
experience a low activating field, (^zf^^i (see Eq. 3.7), and 

3. ) an intermediate population level corresponding to cells in a "suppressed" 
state, that experience a high suppressive field, ^^^^^^2 (see Eq. 3.5). 
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To a good approximation, localized network attractors consist of B cell popu- 
lations at these various levels (Weisbuch et al., 1990). The purpose of this study 
is to investigate the behavior of the Cayley tree model when antibody dynamics 
are introduced; therefore, it is of interest to examine how the system attractors are 
affected by the introduction of dynamical equations for the antibodies. 

When B cell populations are unstimulated, (i.e. f{hi) — Vi), all B cell popu- 
lations attain the virgin steady-state; while the corresponding antibody populations 
diminish to zero. This is an important, but dynamically uninteresting, system at- 
tractor corresponding to the resting state of a classical clonal selection immune 
response model. It would correspond to a completely decoupled immune network. 
In our network model, this state is not attainable if even one antibody population 
is non-zero at steady-state. As we shall see, however, a near-virgin steady-state is 
possible under some conditions. 

Other system attractors likely to exist in this model are localized memory and 
percolation attractors. A localized memory state occurs when the clonal popula- 
tion at one level is high while all other levels remain suppressed or at near-virgin 
levels. For example, a localized memory at level 1 corresponds to a high, activated 
population of level 1 clones, sustained by an intermediate, suppressed population 
of level 2 clones. In order for this state to be considered localized, levels 3 and be- 
yond must remain at low, or near-virgin levels. This attractor is called a localized 
memory because the antigen-reactive clone at level 1 is high and capable of quickly 
eliminating antigen as in a typical secondary immime response. (In a percolation 
attractor, by comparison, levels 3 and beyond would experience activating fields.) 

The first localized state of interest is a special case. In this state level 1 is 
activated, level 2 suppressed, and all others near-virgin. Other localized states 
(where a level other than the first is activated) are a generalization of this result, 
since connectivity backward through the network must be taken into account. The 
conditions for localized memory will be shown to be only slightly more restrictive 
in the general case (see Section 5). 

Estimates for the steady-state populations are greatly simplified using the fol- 
lowing approximations: From Eq. (2.3), for small m (bone marrow source term). 
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approximate B cell equilibria are obtained at the intersections of the curve y — pf{h) 
with the line y — cLb (the B cell death rate), i.e. at 



pf{hi) a; dB ■ 



(3.1) 



Since we are seeking a steady-state with level 2 suppressed, we assume /j.2 ^ ^i, 
thus f{hi) can be approximated by the trailing edge of the activation curve: 



dB = Pf{h2) ~ P 



02 + h2 



where 



h2 = ai + {z - 1)03 



(3.2) 



(3.3) 



Level 3 is assumed to be in a virgin or near- virgin state. Thus as <^ a2- Since level 
1 is activated and level 2 suppressed, 02 < ai; therefore, if z is not too large. 



(3.4) 



To find the approximate steady-state values, we substitute Eq. (3.4) into (3.2). 
Solving for ai, we find 

e2{p-dB) 



Similarly, since level 1 is activated, hi <^ ^2, and 

dB ^pf{hi) ^p 



hi + 01 ' 



(3.5) 



(3.6) 



where hi = za2- Solving for 02 yields 



a2s 



dsdi 



z{p - dB) 



(3.7) 



Substituting aus and a2ss into the steady-state conditions, i.e. Eqs. (2.3) with 
dai/dt = and da2/dt = 0, yields estimates for biss and b2ss' 



'Iss 



O2P 

Sdn 



(p-dB) 

dn 



dA + dcOi 



sz 



- — '^-j-^dA + dc02^ 
[p-dB) dB, 



(3.8a) 
(3.86) 
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The steady-state values for the anti&oc/^/ populations, Eqs. (3.5) and (3.7), turn 
out to be essentially the same as the estimated clone sizes in the corresponding 
localized memory state in the B cell Cay ley tree model (Weisbuch et al., 1990). 
This was to be expected, since it is the field that determines clone size. In the case 
of the B model, the field consists of the B cell population levels; whereas, in the AB 
Tree model, the field consists of the antibody populations. 

For the standard parameter set, the approximate steady-state values are 
hiss = 21,000, aiss = 10,000, h28s = 2,000, a2ss = 10- The accuracy of these 
approximations was tested by numerical calculation of the exact steady-state val- 
ues. The approximate values were found to be within 2% of the numerical values. 
Notice that in an immune state, the antibody population of the memory level, oi, is 
zQijOi times larger than the antibody, 02, of the sustaining, suppressed level. The 
B cell populations, however, differ by a factor approximately equal to z. Thus, the 
clone size of the suppressed population for 2; = 2, for example, is only half the size 
of the activated population. In the case of the two-clone model [z = 1), B\ is only 
slightly larger than the B2 in a stable immune state. 

For the immune steady-state to remain localized, level 3 must not become 
activated, (i.e., pf{hs) < ds or < 6*1^3^). Also, level 4 is assumed to be 
near-virgin, so that 



Substituting the steady-state value for 02 into Eq. (3.9) yields as a necessary 
condition for this localized state 



Thus, for a localized memory to remain localized, there must be more clones in level 
2 than in level 1. This is in agreement with the results of Weisbuch et al. (1990). 

We now estimate the steady-state values for the level 3 populations. Note that, 
since 63 is assumed to be near- virgin, m is not negligible in this case. Approximating 
/(/is) ~ 1(0,2) by its rising part, or 



h3 = a2 + [z - 1)04 a2 



(3.9) 



z > 1 



(3.10) 



(3.11) 
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From Eq. (2.3), at steady-state 



(3.12) 



Substituting a2ss yields 



J3ss 



m z 



1+ 



z{p-dB) 



(3.13) 



The corresponding steady-state antibody concentration is given by 



(d^ -I- dc03ss) 



Substituting Eqs. (3.7), (3.13) and (3.11) into (3.14) yields 



Notice that 



sm{z/{z-l)) 

[dAz{p - ds) + dcdse,] ■ ^''■'^> 



\im bsss ^ m/dB , (3.16) 

«— >oo 



and for large z, 63 is nearly virgin (-^^zf^ = 1 for our standard parameters), consis- 
tent with the condition for a localized state. However, as z increases, a2ss decreases 
(see Eq. 3.7) and a^ss increases until the assumption of Eq. (3.9) becomes invalid. 
This will be shown explicitly in Section 6 using numerical methods, and is illus- 
trated in Fig. 4. Again the accuracy of the approximate steady-state populations 
at level 3 were compared to their numerically determined values. For the standard 
parameter values, the estimated values, bass and a3ss, were 68% and 62% of the 
numerical values. As z is increased from 10, the standard value, this error increases 
significantly. For example, at 2; = 15, the approximate steady-state populations are 
only 34% and 31% of the numerical values. Thus, the estimated steady-state values 
for level 3 are only valid for relatively small values of z. 

Initially, we had calculated the steady-state values for levels 1 and 2 assuming 

that 

h2 = ai + (z — l)a3 ~ ai . 
In order for this assumption to hold, aiss 3> (2; — l)asss, or 
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02 > 



mszdB 



(3.17) 



{p - dB)p[dAz{p - ds) + dcdsOi] 



For our standard parameters, this condition is easily met. Thus, in certain param- 
eter regimes the AB Tree model has localized steady-states. The analysis thus far, 
however, has not put any conditions on the stability of these states. 



We next find conditions under which the localized immune steady-state is sta- 
ble. Stability analysis is greatly simplified if we continue to use the approximations 

(i) hi < 6*2, 

(ii) /i2 > 6*1, and 

(iii) ai > — l)a3. 

Using (i) and (ii), we can approximate the activation function for levels 1 and 
2 by the rising and falling parts of /(/i), respectively. Approximation (iii) allows us 
to ignore population dynamics beyond level 2. Thus, near the localized state, the 
model reduces to the following four-dimensional form: 



Since it assumes no level 3 interactions, this model consists of a single, first level 
clone and z clones at level 2. We shall refer to this reduced model as the "star" 
model. 

To linearize these equations about the steady-state, we compute the Jacobian 



4. STABILITY ANALYSIS 






(4.1) 




r ^ 

db-i 



dbi - 
da2 



J = 



da2 
L dbi 



da2 
da2 - 
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P pza2 J 



za2 



za2+9\ 











-dA - dcza2 

—p92b2 

(ai+02)2 








pe2 

ai+e2 

802 



-d, 





-c/a - dcai 



(4.2) 



and evaluate it for the localized steady-state values (ai^g, a2ss, bigs, ^2ss) given by 
Eqs (3.7) and (3.9)-(3.11). Notice that when these substitutions are made, two of 
the diagonal terms vanish: 



J 





P 








J dcdB0i 

-pd2b2ss 



(ai«s+6l2)2 

— S92b2s 









pz6ibis 



{za23s+6i)^ 

, - dczau 



P 



-dA - 





dc02{p-dB) 



(4.3) 



The eigenvalues, A, of J can be found by solving the characteristic equation 

p = det[XI - J] = , (4.4) 



or. 



p = Co + ciA + caA^ + cgA^ + C4A^ = 



(4.5) 



where p is the characteristic polynomial and Cj's are the coefficients of the charac- 
teristic equation. The coefficients are as follows: 



Co =d%{p - dB)^i-dAdB +pdA + dBdcOi)[dAdB + (p - c^b)c^c^2] 
ci =pip - dB){-dAd%dc9i{2dB - p) + {p - dB^i^d^dB 

- dAdce2{2dB - sp) + 2dBdleie2]} 

C2 =d\dB{p - dB){-2p^ + 2pdB - d\) + dAd%dcOi{d% - dBP + p^) 
+ dAdc02{p - dBfi^p" - SdBP + dl) + dBdleie2{p - dB^ 

C3 =p'^[-2dAdB{l -p) + dldcOi + dc92{p - ^b)^] 

C4 =p^dBip - dB) ■ 



(4.6) 

(4.7) 

(4.8) 
(4.9) 
(4.10) 
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Surprisingly, the characteristic equation is independent of the coordination 
number, z. (All z terms of the characteristic polynomial are common factors.) 
This is still true when the exact Jacobian is used (that is, the Jacobian taken using 
the full j{K) and not simply it's rising and falling parts). What this implies is that 
stability is insensitive to the asymmetry in the model due to the fact that there is 
one level 1 clone and z level 2 clones. Thus, if a localized memory state becomes 
unstable as z is changed, it is due to the interactions with level 3 populations. This 
is explored further in Section 6. 

If we set all parameters to constants and choose one parameter as a variable, the 
characteristic equation allows us to predict stability as a function of that variable. 
For example, if we vary the antibody death rate, dyi, leaving all other parameters 
at their standard values, we get the characteristic equation as a function of dA with 
the coefficients 

Co = 6.25 + 6.31d^ + 0.0625d^ , (4.11) 

ci = 25 + 50dA + 0.25di , (4.12) 

C2 = 25 + 175.75dA + 1.25d^ , (4.13) 

C3 = 101 + 2dA . (4.14) 

To find stability conditions in this case, it is not strictly necessary to find 
the eigenvalues; inspection of the coefficients of the characteristic polynomial is 
sufficient. The characteristic polynomial is stable if the following conditions are 
satisfied (Lienard-Chipart Theorem (Fortmann and Hitz, 1977)): 

Ci > V z , (4.15) 

and 

C3C2C1 > C3C0 + Ci . (4.16) 

Conditions (4.15) are always met in this example since dA > 0. Condition (4.16) 
predicts that the localized state is stable for values of 



dA > 0.0025 



(4.17) 
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If wc repeat this analysis using the exact Jacobian, we find the shghtly stronger 
condition 

dA > 0.0047 . (4.18) 

Our estimated value of dA is 0.05, and thus with our standard parameters, the 
localized immune state is stable. Note, however, that if the antibody lifetime is too 
short, network interactions leading to localized memories cannot be sustained. 

Similarly, conditions can be derived by varying other parameters. Setting dA = 
0.05 and freeing dc yields 



Co = .00015625 + 31.5625dc + 62500dl 


(4.19) 


ci = .000625 + 250000(ic + 250d^ 


(4.20) 


C2 = .003125 + 878.75dc + 250000d^ 


(4.21) 


C3 = 10100 + 0.1dc 


(4.22) 


dc > 0.0060 . 


(4.23) 



This condition remains essentially unchanged when the exact Jacobian is used. 
Again, with the estimated value, dc = 0.01, our analysis predicts a stable localized 
immune state. 

5. LOCALIZED STATES AT OTHER LEVELS 

As previously noted, a localized state with level 1 high is a special case in that 
clones at lower levels need not be considered. Localized states at other levels are 
of interest as a generalization of the previous analysis as well as their potential 
biological relevance. For example, a localized state with level 2 high and level 1 low 
or intermediate has been referred to as a "tolerance attractor" (Weisbuch et al., 
1990; Neumann and Weisbuch 1992a). A high level of Ab2 suppresses the primary 
antibody response rendering the network unresponsive, or "tolerant", to antigenic 
challenge. 

To find the conditions for a localized state with a level other than level 1 high 
requires a similar analysis. Consider a state with high (e.g. aj ^ 62)- Level i — 
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experiencing a field of ai-2 + {z — l)aj, will be far into the suppressive range of 
the dose-response curve; consequently, ai-i will be very low, perhaps near-virgin. 
Thus, the only assumption in section 3 that changes is the the approximation for 
the level i field 



hi = ai_i + [z- l)ai+i ^ [z- l)aj+i 
The steady-state values are then given by 

e2{p-dB) 



{z-l){p-dB) 



O2P 

sds 



(P - ds) 



ds 



dA + dcdi 



dA + dc02 



{p-ds) 
dn 



(5.1) 

(5.2) 
(5.3) 
(5.4) 
(5.5) 



~ s{z-l){p-dB) 

An example of a "tolerance" attractor (a localized steady-state at level 2, with a 
sustaining population at level 3) is shown in Fig. 2. 

The necessary condition corresponding to Eq. (3.10) for this localized state is 



z>2 



(5.6) 



The unit increase in the condition on z is a direct consequence of network structure. 
A similar condition has been found for more general structures (Neumann and 
Weisbuch 1992b). This condition is really the same as Eq. (3.14); that is, there 
must be more than one connected clone descending down the Cayley tree. Thus, the 
simplest structure which can support tolerance is a tree with coordination number 
z = Z (see Fig. 1). 



6. NUMERICAL BIFURCATION ANALYSIS 



Having established some approximate conditions for stable, localized steady- 
state network behavior from the star model, we wish to know what happens to these 
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states as model parameters are changed and the stabihty conditions are violated. In 
this section, we analyze steady-state behavior of a more complete model of a Cayley 
tree model using a numerical bifurcation analysis software package, AUTO (Doedel, 
1981; Taylor and Kevrekidis, 1990). The following numerical work was performed 
on a ten- level Cayley tree model (fields due to levels 11 and beyond are assumed 
to be zero). The result is a 20-dimensional system of equations (one equation for 
each B cell and antibody population at each level). In analyzing bifurcations that 
occur as z is varied, we treat 2 as a continuous variable. However, strictly speaking, 
Cayley trees are only defined for integer values of z. 

6.1 Nondimensional Model 

First, we nondimensionalize the model equations to reduce the number of model 
parameters. For comparison, we have attempted to choose dimensionless units 
which are roughly equivalent to those in De Boer and Perelson's (1993a,b) analysis 
of two-clone models. Accordingly, the time scale is based upon the B cell lifetime, 
i.e. T = tds- We scale the antibody concentration by a factor, a = \fB\d-i-, which 
corresponds to the concentration of antibody which leads to maximum crosslinking 
(activation). We then scale the B cell population by a factor, = ((i^Q;)/s, the 
concentration of B cells required to sustain a steady-state population of a anti- 
bodies (at maximum activation and ignoring complex formation). The remaining 
quantities, hi,9i, and 62 are scaled by a. The nondimensional dynamical equations 
become 




(6.1) 



f{Hi) 



62 



(6.2) 



{Qi + Hi) {02 + Hi) 



where Qi = 9i/a, and ©2 = ^2/0;- 



dT 



(6.3) 



dAi 



iyf{Hi)Bi-{S + iiHi)Ai , 



dT 



where 



Ai = ai/a, Bi = bi/P, 6 = dA/dB, a = m/{(3dB), p = p/dB, 
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V = f3s/{adB), iJ, = {adc)/dB, a = \/ (5={adA)/s. 

The corresponding standard, non-dimensional parameter values are 5 = 0.1, u = 
0.04, p = 2,v = 0.1, = 20, a = 1000, and (3 = 50. 

6.2 Connectivity Dependence of Localized Steady States 

The connectivity parameter z is the only new feature added to the basic two- 
clone AB model (De Boer et al., 1993a,b). We introduce a network structure to 
the two-clone model when z > 2. Thus, we first investigate the dependence of 
the localized steady-state on the connectivity parameter, z. Figure 3 shows the z- 
dependence of two different localized steady-states, one with level 1 high (a localized 
immune state) and one with level 2 high (a localized tolerance attractor). With all 
other model parameters set to the standard values, conditions for stability of these 
states are 1 < 2; < 15 and 2 < 2; < 16, respectively. For 2; = 1, these steady-states 
correspond to the "HM" and "MH" states in the two-clone AB model (De Boer et 
al., 1993a,b). As discussed in Sections 3 and 4, the upper limits on z are imposed 
from interactions with level 3 populations. As z gets large, the approximation for 
the field at level 3, {h^ = a2 + {z — 1)04 fa 02, Eq. (3.9)), breaks down. As the 
field at level 3 increases, it's clonal population increases until it begins to stimulate 
higher-level clones. 

Both of the localized states (with levels 1 and 2 non-virgin) exist as "isolated" 
solutions; that is, as z is varied the steady-states do not branch into other attractors, 
but rather loop back on themselves. In Fig. 3, the lower branches, indicated by the 
dashed lines, are unstable. 

6.3 Extended Localization and Percolation Attractors 

The stability of the localized immune state is independent of z in the two-level, 
star model; therefore, it is the interactions with deeper levels in the immune network 
which destroys the immune state. As z is increased, clone 3 begins to expand far 
enough above virgin levels to stimulate proliferation of level 4 clones. We refer to the 
loss of localization as structural^ since system steady states are dynamically stable, 
while localized states are lost due to changes in the model structure (connectivity). 
As discussed above, the assumption that hz = a2 + {z — l)a4 ^ 02, Eq. (3.9), only 
holds for small z. In Fig. 4, the two components of the field experienced by level 
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3 clones is plotted against z. As {z — 1)^4 becomes comparable ^42, the localized 
immune state is lost. 

For high stable steady-states still exist, but these states correspond to "ex- 
tended localization" (Neumann and Weisbuch 1992a) and "percolation" attractors, 
where many levels are maintained at high populations. Figure 5 shows the dynam- 
ical trajectory which results when the localized memory state is lost [z = 16). The 
initial system state was chosen to be the immune state for z = 15. At t=0, z was 
increased to 2; = 16, and Eqs. (6.3) were integrated numerically. Since no localized 
immune steady-state now exists, the trajectory moves into a new basin of attraction 
(in this case an extended localization with B cells at levels 1 and 4 high, 3 and 5 
intermediate, and deeper levels near- virgin) . This state exists for a slightly larger 
range, 2; < 19 (Fig. 3). If we continue to increase 2;, activation cascades further 
down the network resulting in a percolation attr actor. 

Percolation attractors can coexist with localized steady-states in the AB Tree 
model. Notice in Fig. 3 that for 2 < 2; < 16, the extended localized attractor coex- 
ists with a tolerance attractor. Thus, when the localized memory state disappears 
as z is increased, it does not spawn a new attractor; trajectories simply approach 
other existing (immune, virgin, or one of the percolation) attractors - depending 
upon initial conditions. 

6.4 Dependence of the Localized Steady State on Antibody 
Dynamics 

The inclusion of antibody populations as state variables in the Cayley tree 
model introduces two important parameters, the antibody death rate, (Ia, and the 
complex removal rate, dc, i.e., dimensionless parameters S and respectively. 
Varying these parameters can change steady-state behavior into chaotic behavior. 
The loss of localization in this case is dynamical, since nearly all stable steady state 
behaviors (including percolation attractors) are lost with changes in the dynamical 
variables. 

The stability of the localized immune steady-state as a function of 5 (the ratio of 
antibody/B cell death rates) is shown in Fig. 6. If 5 is increased from its standard 
value of 0.1, the eigenvalues become increasingly negative, i.e. more stable (not 
shown). As 5 is decreased from 0.1, a Hopf bifurcation occurs at 5 ^ 0.0136, and 
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the steady-state goes unstable. For the "standard" parameter value = 0.5, this 
corresponds to the condition (Ia = 0.0068, which is close to the estimate provided 
from linear stability analysis of the star model (Eq. (4.18) (Ia > 0.0047). The 
Hopf bifurcation branch consists of unstable limit cycles, while continuation of the 
primary branch follows an unstable steady-state. Most attractors in this region are 
chaotic, although some are steady-states with levels other than level 1 high. 

Localized states can also loose stability if the complex formation parameter, 
becomes too small. Figure 7 is a bifurcation diagram of the level 1 (immune) local- 
ized steady-state with fi as the bifurcation parameter. Beginning with the standard 
value {fj, = 20), the steady-state becomes unstable at the Hopf bifurcation as /j, 
drops below 12.45. For the standard parameter set, instability corresponds to the 
condition dc < 0.00623. This, also, is in close agreement to the estimate of 0.0060 
from linear stability analysis of the star model (Eq. (4.23)). Past the Hopf bifurca- 
tion, the steady-state is unstable with 2 complex eigenvalues, both having positive 
real parts. At the saddle-node bifurcation, an additional positive, real eigenvalue 
appears; thus, along the lower branch of the bifurcation curve the system has 3 
eigenvalues with positive real part. At /j, = 12.1, the complex eigenvalues re-cross 
the imaginary axis, but the single unstable eigenvalue persists becoming increas- 
ingly unstable with increasing /i. The branches from the two Hopf bifurcations 
consist of unstable limit cycles. In the region past the first Hopf bifurcation, i.e. 
fi < 12.45, system attractors, other than the virgin state, appear to be chaotic. 
For ij, > 12.45, the immune state is stable and surrounded by an unstable limit 
cycle. This unstable limit cycle, along with its stable manifold, define the basin of 
attraction of the stable immune state. 

Figure 8 is a two-parameter continuation of the localized immune state. Assum- 
ing standard values for the other parameters, this diagram shows the combinations 
of ji and 6 for which the localized immune state at level 1 exists, as well as whether 
it is stable. No localized immune steady-state exists below the saddle-node curve. 
The two broken lines indicate the boundaries for Hopf bifurcation curves (HB-1 
and HB-2). The steady-state is stable only above the first Hopf bifurcation (HB-1). 
In the region between the saddle-node and Hopf bifurcation curves, only unstable 
steady-states exist. The one parameter continuations in Figs. 6 and 7 project onto 
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this diagram as a vertical line at |U = 20 and a horizontal line at S = 0.1, respec- 
tively. This diagram qualitatively corresponds to Fig. 3 in Perelson and Weisbuch 
(1992) and De Boer et al. (1993a,b). 

Figure 9 is a two-parameter continuation of the saddle-node and Hopf bifurca- 
tions of the localized steady-state at level 1 varying one dynamical parameter, fx, 
and the connectivity parameter, z. As fi is lowered, the localized steady-state exists 
and is stable for a decreasing range of z. At approximately /j, = 12.5, the steady- 
state becomes unstable for all values of z, and remains unstable for all /j, < 12.5. 
The loss of stability occurs via a Hopf bifurcation. The limit cycles that appear are 
unstable. Again, network connectivity, z, mostly determines the existence of the 
localized state and the dynamical parameter primarily determines the stability of 
the steady-state. The one parameter continuations in Figs. 3 and 7 project onto 
this diagram as a vertical line at 2; = 20 and a horizontal line at = 20, respectively. 

6.5 Chaotic Attractors 

As system parameters are varied past the Hopf bifurcations, the dynamics can 
become chaotic. To study the dynamics we use the dimensional equations (2.3). In 
Figs. lOa-h, a series of time plots and phase portraits are shown for 2 = 10 as dc is 
decreased past the critical value of 0.00623, and the localized steady-state becomes 
unstable. Beginning with the standard parameter set {dc = 0.01), the localized 
memory state is asymptotically stable (Figs. 10a,b). As dc is lowered toward 
the Hopf bifurcation at dc ~ 0.00623, the basin of attraction for the localized 
steady-state shrinks. Because the steady-state is surrounded by an unstable limit 
cycle, a large enough perturbation will cause trajectories to move away from the 
steady-state and approach another attractor. This is illustrated in Figs. 10c and 
d for dc = 0.0067. Here a large perturbation was given and the trajectory slowly 
moves away from the steady-state, goes through a transient, and then approaches 
an apparently chaotic attractor. This attractor resembles the Lorenz attractor 
(Sparrow, 1982) in that the trajectory spirals around two stable states, one with ai 
high, the other with 02 high. Just past the Hopf bifurcation {dc — 0.0060), chaotic 
trajectories are also observed. In Figs. lOe and f it is seen that the trajectory 
often returns to the region in state space near the unstable steady-state. As dc is 
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reduced further, the attractor becomes increasingly dispersed in state space. This 
is iUustrated in Figs. lOg and h for dc = 0.001. 

The time course of a typical chaotic attractor is shown in Fig. 11. At time 
t=100, a large dose (10^) of Ahi is "injected" into the system. As can be seen, this 
causes Ahi and Ah2 to stop fluctuating for about 50 days, while leaving ^63, Ah^i 
and Ah^ fluctuating (Fig. 11a). After 50 days, the system relaxes back into the fully 
chaotic state. Doses of injected antibody of order 10^ or less have little effect on 
network dynamics and the fluctuations continue unabetted. For larger z, a larger 
dose is needed to disturb network dynamics due to the large number of connected 
clones at level 2 (Fig. lib). 

6.6 Localized Chaos and Limit Cycles 

In the two-clone AB model, stable limit cycle attractors were found over a wide 
parameter range (De Boer et al., 1993a,b). With large amplitude oscillations in level 
1 and 2 antibody populations, however, level 3 would be expected to be stimulated 
past the virgin threshold, leading to percolation or chaos. Indeed, when the system 
parameters were set to those of the oscillatory regime of the two-clone model (e.g. 
/i < 12.68, dimensional value dc < .00634), chaotic dynamics spread throughout 
the network, even for z=2. Moreover, even in the parameter regime in which the 
two-clone AB model exhibits limit cycle behavior (// < 0.18), the AB Tree model 
shows chaotic behavior for small z. Thus, the introduction of even the most minimal 
network structure, a linear chain, disrupted the limit cycle oscillations observed in 
the two-clone model. 

The potential exists for localized oscillatory states if the oscillations of 02 re- 
main sufficiently small, i.e. below the threshold for activating level 3, such that the 
condition a2max < (^zf^^i is fulfilled. On the other hand, the oscillations of 02 
must be smaller then the suppressive threshold in order to sustain oscillations at 
level 1, i.e. h\max = zo-2max = ^^^^^^2- By combining the above two expressions 
we obtain a sufficient condition for localized oscillations. 



(6.4) 
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enough so that hi = za2 

< i£^^2- For our standard parameter set, this condition 

is satisfied for ^ > 100. 

Indeed, stable hmit cycles have been found in high connectivity parameter 
regimes. One such attractor is shown in Fig. 12a,b. These limit cycles are only 
structurally stable when the bone marrow source term is extremely small so that 
virgin B cell clones are too small to be activated easily (m = .000025). As dc is 
increased, the limit cycle becomes unstable, and system dynamics are character- 
ized by long-lived oscillatory transients which do not activate higher level clones 
(Fig.l2c,d). At even higher values of dc, a localized chaotic attractor appears (Fig. 
12e,f), where chaotic oscillations at levels 1 and 2 do not substantially disturb the 
near-virgin populations deeper in the network. 

7. DISCUSSION 

7.1 More Complex Network Structures 

We have studied the behavior of antibody-B cell immune networks that have 
the topology of a Cayley tree. A Cayley tree is a homogeneous network, without 
loops, in which every node is connected to precisely z others. The Cayley tree 
is clearly only an approximation to real immune network topology. While each 
clone in a network may be connected to z others (on average) it is unlikely that 
all clones would ever be connected to exactly z others. Natural IgM antibodies in 
neonatal mice, when tested in binding assays, exhibit highly variable reactivities 
(Holmberg et al., 1984; Holmberg, 1987). Many of the antibodies are found to be 
highly multireactive, while others are specific. Thus, at least in this example a 
homogeneous topology does not seem to exist. The effect of variable connectivities 
on system attractors has been studied for the B cell Cayley tree model (Neumann 
and Weisbuch 1992b) but not on the AB Tree model. 

Further evidence of network structures that differ from the Cayley tree model 
comes from functional distinctions between classes of second level antibodies (Jerne, 
1974; Jerne et al., 1982). Primary antibodies (Abis) recognize epitopes of an 
antigen. Secondary antibodies (^62 's), can recognize either idiotopes or paratopes 
of Abi . If an Ab2 recognizes an idiotope outside the binding site it is classified as an 
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Ab2ct antibody, while if it recognizes the paratope of Abi it is referred to as an 
or "internal image" antibody, since it mimics the shape of the original antigenic 
determinant. Internal images are not accounted for in a Cay ley tree structure since, 
as we show below, they generate loops. 

An internal image could be added to a network model. Consider network with 
coordination number z and an external antigen as it's root (see Fig. 13). An internal 
image would be indistinguishable from the antigen itself. If we allow a fraction fi 
of the second level antibodies to be internal images ^62/3 of the antigen, the fields 
become: 

hi = Ag + z[iJ,a2/3 + (1 - /i)o2a] , (7.1) 

where Ag is the effective antigen concentration. If we assume that the Abis rep- 
resent the dominant idiotypic interactions for an internal image, the field for the 
internal images is 

/i2/3 = zai , (7.2) 

(If one were to include further connectivity, a separate population of Abs^s would 
need to be added.) The Ab2aS would retain a tree- like connectivity: 

h2a = ai + {z- 1)03 . (7.3) 

The inclusion of internal images violates the tree structure, and the dynamics of 
the Ab2aS and Ab2f3^s must now be treated separately. 

Kohler subdivides A62 antibodies differently than Jerne et al. (1984) by defin- 
ing a "network antigen" as an A62 that can be used for vaccination (Kohler et al., 
1989; Kohler, 1991). Network antigens do not necessarily meet the immunochemical 
criteria of internal images, but still are capable of inducing biologically beneficial 
immune responses. Network antigens and internal images have been used to prime 
an immune response without exposing an animal to the antigen itself (Kohler et al., 
1986; Huang et al., 1988; Raychaudhuri et al., 1990; Bhattacharya-Chatterjee et 
al., 1990) and hence have obvious use as potential vaccines. Antibodies connected 
in loops may be used to model the connectivity of a network antigen (Fig. 13). 

It is not only internal images and network antigens that generate loops, but 
as pointed out by Neumann and Weisbuch (1992b), any recognition scheme based 



Anderson, Neumann &: Perelson 



page 26 



on complementary shapes implies a network with loops. For example, if Ab2 and 
Ab4 resemble each other, they may both interact with A63 and Abi forming a four- 
membered loop. In the case of B models, Neinnann and Weisbuch (1992b) have used 
the window automata approximation (Neumann and Weisbuch, 1992a) to analyze 
the effects of simple loops on the existence and stability of localized states. Similar 
analyses remain to be done for AB models. 

7.2 Oscillations and Immune Memory 

Immune networks may be able to store memories in the form of dynamic steady- 
states (Farmer et al., 1986; Weisbuch, 1990; Weisbuch et al., 1990; Behn ct al., 
1992). Generally, when networks are used to explain memory to previous antigenic 
challenge the following implicit hypotheses are made (cf., Weisbuch et al., 1990): 

(i) The immune system is antigen-driven; that is, prior to antigenic challenge, 
clones are in a stationary, virgin state. 

(ii) Antigenic challenge can force clones from the virgin state into other states, 
such as those that correspond to immune and tolerant attractors. 

(iii) If the new attractors that the system is driven to remain localized, the 
network will be capable of storing memories of many different antigens. 

Some recent experimental data, however, do not support the hypothesis that 
the immune system is antigen-driven and that immunological memory is stored in 
stable, localized steady-states. 

Measurements of naturally occurring antibody (NAb) concentrations in vivo at 
various times show complex dynamics. In the absence of external antigenic stim- 
ulation individual NAb concentrations fluctuate irregularly over time (Lundkvist 
et al., 1989; Varela et al., 1991). Based on Fourier spectra of rather limited time 
series, Lundkvist et al. argue that the fluctuations appear to be chaotic. However, 
because the data are so limited it is uncertain whether these fluctuations indicate 
the existence of a chaotic attr actor, a high-dimensional limit cycle or are simply 
the result of noise and perturbations about a non-virgin steady-state. In germ-free 
mice the number of activated lymphocytes in the spleen and the serum level of IgM 
are similar to the values measured in conventionally raised animals (Hooykaas et 
al., 1984; Pereira et al., 1986). These data as well as the Lundkvist data indicate 
that the immune system is not in a rest state in the absence of external antigen. 
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Coutinho (1989) has argued that about 10-20% of the immune system is orga- 
nized into an idiotypic network, or "central immune system" that is active in the 
absence of external antigen, and that the remaining 80-90% of clones are outside 
the network and constitute a "peripheral immune system" that is responsible for 
immune responses to foreign antigens. Thus, according to Coutinho, secondary re- 
sponses and hence memory would be non-network derived. Whether a system in 
which clones and their anti-idiotypic clones were in localized states and relatively 
unresponsive to other activities in the network would correspond to the network or 
non-network parts of the system is unclear. Clones in the immune state could par- 
ticipate in rapid responses to antigen characteristic of secondary immune responses. 
However, while in the immune state they would be activated and subject to network 
interactions with their anti-idiotypic clone. 

Lundkvist et al. (1989) did one additional experiment suggesting that the fluc- 
tuations in NAb populations are not due to noise. They showed that the fluctuations 
in the serum concentrations of natural antibodies with complementary idiotypes, 
which for notational simplicity, we call Abi and Ab2, could be eliminated for three 
months by injection of monoclonal antibodies with the idiotypes carried by either 
Abi or Ab2- Interestingly, the dynamics of serum antibodies with unrelated idio- 
types remained relatively undisturbed and continued to fluctuate (Lundkvist et al., 
1989). This might suggest that dynamical network activity remains localized in the 
immune network since dynamical behavior in only part of the immune system was 
noticeably changed. 

We performed a similar experiment of injecting Abi in our Cayley tree model 
when in a "chaotic" parameter regime. We found, as did De Boer et al. (1990, 
1993b) for the two-clone AB model, that injection of high doses of Abi could elim- 
inate oscillations in Abi and Ab2 for a period of months (Fig. 11). However, low or 
moderate dose injections frequently would not lead to a loss of oscillations, the out- 
come depending on parameters values and the concentrations of antibodies present 
in the system at the time of the injection. Interesting, however, is that when os- 
cillations at the Abi and Ab2 levels were eliminated, the higher levels Abs, Ab^, 
and Ab^ still oscillated (see Fig. 11). Thus in the AB Cayley tree model we can 
reproduce this second feature of the Lundkvist experiments that was not apparent 
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in the previous two-clone AB models. Further, our model indicates that the con- 
tinued fluctuations in higher levels of the tree, while fluctuations at levels 1 and 2 
are eliminated, do not indicate that network activity is localized. In fact, this effect 
is seen in the model in the chaotic/percolating parameter regime. The explana- 
tion of this phenomenon in our model is that with high Abi, B cells at level 2 are 
suppressed and Ab2 concentration levels are brought very low by a combination of 
complex formation with Abi and lack of production by suppressed B cells. Since 
level 3 is influenced by both level 2 and level 4, it can continue to oscillate with A62 
very low as long as level 4 can stimulate it. In the chaotic regime, A64 gets high 
enough to trigger level 3 and continue the percolation to higher levels. 

The Lundkvist data suggests that if immune memory is stored in dynamical 
attractors they must be more complex than simple point attractors. It is difficult to 
envision memory storage in the global percolation and chaotic attractors found in 
the AB Tree model; however, the localized chaotic and limit cycle attractors found 
in section 6.6 could serve a localized memory role. Although these attractors were 
only found in very extreme parameter regions, in many other parameter regimes, 
transient oscillations around a steady-state may persist for as long as the lifetime 
of a mouse. For example, in Fig. 10c a large perturbation around a stable immune 
state produces slowly growing oscillations that last about 700 days. 

Although the natural state of an immune network might be oscillatory, one 
would expect that if antigen drives the network then the time-averaged Abi popu- 
lation level would be much higher after antigenic challenge than before challenge. 
Indeed, the immune response to some antigens is oscillatory (Weigle, 1975; Romball 
and Weigle, 1982; Hiernaux et al., 1982) with the time-averaged antibody concen- 
tration remaining high for many weeks or months after antigenic challenge. The 
oscillations are usually damped and may reflect a slow return to a steady-state. 

Thus, even if the immune system operates in an oscillatory or percolation 
regime it is still possible for memory to be stored dynamically. If responses stay 
localized it is easy to envision how both memory storage and memory recall would 
work. If responses do not stay localized it is much more difficult to see how the 
immune system could utilize dynamic memory. But this is not to say that it would 
be impossible. Neural networks of the Hopfield type store memory in a non-local 
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manner and this provides certain advantages if damage occurs to particular parts 
of the network. 

7.3 Conclusions 

The AB Tree model differs from previous models in that it adds a simple 
network structure to the two-clone AB models and antibody dynamics to B cell 
Cayley tree models. We have shown that the inclusion of antibody dynamics does 
not change the general conclusion of Weisbuch et al. (1990) that there can exist 
stable localized memory states in a Cayley tree immune network model. 

Besides the immune, tolerant and extended localized steady-states, we have 
identified two other classes of localized system attractors: limit cycles and localized 
chaotic attractors. Global system attractors include virgin, percolation and chaotic 
attractors. Percolation attractors are stable steady-states where many, if not all, 
network levels are non- virgin. In the AB Tree model, percolation attractors coexist 
with localized memories in many parameter regimes. 

The primary new variable introduced in the AB Tree model from the two- 
clone AB models is the network connectivity, or more precisely, z, the coordination 
number of the tree. As z is increased, stable localized steady-states disappear, 
and only percolation and chaotic attractors remain (Fig. 3). This breakdown of 
localization is due to interactions with an increasing number of connected clones 
at higher levels in the tree. Chaotic attractors do not exist in the B cell Cayley 
tree model. In parameter regimes where the two-clone AB model shows limit cycle 
behavior, the AB Tree model exhibits chaotic behavior. But, in highly connected 
networks, limit cycle behavior reappears, along with an interesting new type of 
system attr actor - a localized chaotic attractor. 

In the dynamical simulations presented here, chaotic or oscillatory behavior 
usually percolates indefinitely through all levels. Information could not easily be 
stored in such attractors. However, based on the Lundkvist experiments wc believe 
it likely that oscillatory or chaotic attractors exist in real immune networks (Section 
7.2). The AB Cayley tree model leaves out important idiotypic interactions, such 
as internal images, and features such as gcaring-up (Scgcl and Perelson, 1989) and 
separate spleen and blood compartments (Perelson and Weisbuch, 1992; De Boer 
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et al., 1993a,b). Whether including additional features in the model will serve to 
localize the dynamics in the network remains to be explored. 
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Figure 1. Topology of a homogeneous Cayley tree. Each node represents a clone 
- both the B cell population and its secreted antibody concentration. Each clone 
is connected to z adjacent clones. A Cayley tree with coordination number z = \ 
is equivalent to a two-clone model. A Cayley tree with z = 1 corresponds to a 
linear chain with clone 1 as the root of the tree. With 2; > 3, a Cayley tree is a 
representation of a network without loops. 

Figure 2. Dynamical response to a perturbation of a localized tolerance attrac- 
tor at level 2. A perturbation of the localized steady-state at level 2 returns to its 
attractor. (a) B cells and (b) antibodies at levels 1 through 5 are shown. The con- 
nectivity parameter, 2;, is set to 16, where a localized memory cannot exist. Other 
system parameters are set to their standard values: Q\ = 100, 62 = 10^, p = 1, 
s = 1, m = 1, ds = 0.5, dA = 0.05, dc = 0.01. The initial conditions are bi = 5000, 
ai = 9000, 62 = 17000, 02 = 5000, 63 = 631, as = 3.19, 64 = 3.16, 04 = 2.1, 
65 = 2.09, as = 0.605, be — bio = 2, ae — oio = 0. 

Figure 3. Bifurcation diagram with z as the bifurcation parameter. All other 
parameters are set to their standard values (see text). The vertical axis indicates 
the highest B cell population in the localized state (i.e. Bi for the immune state; B2 
for the tolerant state). The localized steady-state remains stable for a wide range 
of values for z. The lower branch is unstable. The localized state at level 2 exists 
for a slightly larger range of z than the localized state at level 1. Steady states 
also exist for larger values of z, but they correspond to "extended localization" 
attractors or "percolation attractors" , where clones at many levels are sustained at 
high steady-state populations. (See Fig. 5) 

Figure 4. Nondimensional level 3 field versus z. The field experienced by level 
3 clones, = A2 + [z — 1)^4, consists of two components. Steady state estimates 
in Section 3 were based on the assumption that A2 dominates the field. As z is 
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increased, however, this assumption breaks down, and the locahzed immune state 
is lost. 

Figure 5. Extended locahzed attractor in high z. Example of a system attractor 
past the limit point for a localized memory state {z — 16). Activation at many levels 
is referred to a "extended localized state" (Neumann and Weisbuch, 1992a). At t = 
a system in a localized immune state for z = 15 has z increased to 16. This localized 
state is slowly lost, and after a transient, an extended localized attractor is attained. 
When z is increased further, this extended localization breaks down, and the system 
converges on a percolation attractor. The nondimensional concentrations of (a) B 
cells and (b) antibodies at levels 1 through 5 are shown. Other system parameters 
are set to their standard values: ©i = 0.1, 62 = 10, 5 = 0.1, a = 0.04, p = 2, 
u = 0.1, II = 20, a = 1000, and /? = 50. The initial conditions are Bi = 418, 
Ai = 9.773, B2 = 26.8, A2 = 0.0068, B3 = 0.134, A3 = 0.00396, S4 = 0.112, 
A4 = 0.0034, S5 = 0.10, A5 = 0.0031, Bq = 0.089, Aq = 0.0028, S7 = 0.077, 
Ar = 0.0025, Bg = 0.062, As = 0.0021, Bq = 0.047, Ag = 0.0013, BiO = 0.041, 
AiO = 0.00043. 

Figure 6. Bifurcation diagram of the localized immune state with 5 as a vari- 
able. All other parameters are set to their standard values. The nondimensional 
Bi population is plotted. As 5 drops below 0.0136, a Hopf bifurcation occurs. The 
branch of the Hopf bifurcation consists of unstable limit cycles, while continuation 
of the primary branch leads to an unstable steady-state. Most attractors in this 
region appear to be chaotic. 

Figure 7. Bifurcation diagram of the localized immune state with fiasa variable. 
The solid line indicates the nondimensional Bi population in the localized, stable 
immune steady-state. Continuation through a Hopf bifurcation (at n = 12.45) leads 
to an unstable steady-state with 2 unstable complex eigenvalues. (The numbers in 
the figure legend indicate the number of eigenvalues with a positive real part on each 
branch). After the saddle- node bifurcation, an additional real positive eigenvalue 
appears, which gets larger for larger values of fx. A second Hopf bifurcation occurs 
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at fi = 12.1 as the complex eigenvalues re-cross the imaginary axis, but the single 
positive eigenvalue persists. Both branches born at the Hopf bifurcations define 
unstable limit cycles. 

Figure 8. A two parameter (/x, S) continuation of the localized immune state. 
Assuming the standard parameter set for all other values, this diagram shows the 
combinations of fj, and S for which the localized memory state at level 1 exists as well 
as whether it is stable. Legend Key: SN = Saddle-node, HB-1,2 = Hopf bifurcation 
curves. The localized steady-state does not exist in the parameter regime below 
the saddle-node curve. The localized steady-state is stable only above the upper 
Hopf bifurcation curve (HB-1). This diagram qualitatively corresponds to Fig. 3 in 
Perelson and Weisbuch (1992). 

Figure 9. Two parameter continuation (z, jj) of the localized immune state. All 
other parameters set to the standard values. Network connectivity, 2;, determines the 
existence of the localized steady-state; while the dynamical parameter, determines 
the stability. The steady-state is unstable below the upper Hopf bifurcation curve. 

Figure 10. Time plots and phase plot projections of attractors as the local- 
ized steady-state becomes unstable. A 2-dimensional projection of a 10-dimensional 
state-space into the ai — 02 plane is shown. Because this is a projection, trajec- 
tories may cross. Parameter values: (a, b) dc = 0.01, (c, d) dc = 0.0067, (e, f) 
dc = 0.0060, and (g, h) dc = 0.0010. Other parameters are set to their stan- 
dard values. The initial conditions are bi = 13900, ai = 9800, 62 = 1300, 02 = 10, 
63 = 3.4, as = 3.2, 64 = 2.4, 04 = 1.7, 65 = 2.07, 05 = 0.58, be-bio = 2, ae-aw = 0. 
B cells and antibodies at levels 1 through 5 are denoted by the symbols asterisk, 
box, octagon, diamond and cross, respectively. 

Figure 11. Dynamics of a chaotic attractor. The parameter dc is set past the 
Hopf bifurcation [dc = .005), and hence in the chaotic regime. At time t = 100, the 
system is perturbed by a large (10^) dose of Abi. (a) z — 2, (b) z=33. The same 
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sized injection has little effect on the more highly connected network. Other system 
parameters are set to their standard values: 6i = 100, 62 = 10'^, p = 1, s = 1, m = 1, 
ds = 0.5, dA = 0.05. The initial conditions are hi = 13900, ai = 9800, 62 = 1300, 
02 = 10, 63 = 3.4, as = 3.2, 64 = 2.4, 04 = 1.7, 65 = 2.07, 05 = 0.58, 65 - ^'lo = 2, 
- oio = 0. 

Figure 12. Phase and time plots of a localized limit cycle (a,b), a localized 
oscillatory transient (c,d), and a localized chaotic attractor (e,f). Attractors in a 
highly connected network (z = 100) with small bone marrow source term (m = 
2.5X10"^) do not necessarily activate levels deeper in the network simply due to 
oscillatory behavior. All three trajectories shown orbit two unstable steady states. 
Initial conditions for limit cycle {dc = .00009): bi — 46.3, ai = 30.7, 62 = .165, 
a2 = 75.5, 63 = .000785, 03 = .00393, 64-610 = 10"*^, a^-aio = 0. Initial conditions 
for localized transient {dc = .0025) and localized chaos {dc = .005): 61 = 7270, 
ai = 6970, 62 = 126, 02 = 2.04, 63 - 610 = .00005, - aio = 0. Other system 
parameters: 9i = 100, O2 — 10"^, p — 1, s = 1, ds — 0.5, dA = 0.05. 

Figure 13. Schematic diagram of some idiotypic interactions absent in a Cay ley 
tree model. Internal images (^62/3) mimic the structure of the original antigenic 
epitope (Ag); therefore, they are topologically substitutable for antigen in a network 
model. ^62a's, which do not mimic antigenic structure, yet crossreact with more 
than one Abi may serve as a model for network antigens. 



